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Abstract. We study the long time behaviour of the transient before the collapse on 
the periodic attractors of a discrete deterministic asymmetric neural networks model. 
The system has a finite number of possible states so it is not possible to use the term 
chaos in the usual sense of sensitive dependence on the initial condition. Nevertheless, 
at varying the asymmetry parameter, fc, one observes a transition from ordered motion 
(i.e. short transients and short periods on the attractors) to a "complex" temporal 
behaviour. This transition takes place for the same value at which one has a change 
for the mean transient length from a power law in the size of the system (N) to an 
exponential law in N. The "complex" behaviour during the transient shows strong 
analogies with the chaotic behaviour: decay of temporal correlations, positive Shannon 
entropy, non-constant Renyi entropies of different orders. Moreover the transition is 
very similar to that one for the intermittent transition in chaotic systems: scaling law 
for the Shannon entropy and strong fluctuations of the "effective Shannon entropy" 
along the transient, for k > k^- 
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1. Introduction 

The properties of the low temperature phase of spin systems with random quenched 
couphngs have been object of intesive analysis in the last years [Mezard et a/. 1987, 
Fischer and Hertz 1991]. The interest for such models comes from the study of both 
spin glasses and neural networks [Amit 1989]. One of the best known among these 
models, the Serrington - Kirkpatrick (SK) model, is a fully connected version of a 
spin glass. Here the interactions between pairs of spins are random, quenched and 
symmetric. This leads to a large number of metastable states which are responsible 
for the complicated dynamical behaviour of this and related models. 

From a biological point of view the constraint of symmetric interactions is 
unsatisfactory. In fact, in the language of neural networks, two neurons will not 
act on each other in a symmetric way. It is then natural to investigate models with 
asymmetric couplings between spins [Amit 1989]. 

Apart from these biological motivations, the study of disordered spin systems with 
asymmetric bonds is also an interesting problem from the viewpoint of non equilibrium 
statistical mechanics. In fact for these models one no longer has a Hamiltonian and 
a detailed balance condition, and therefore no fluctuation dissipation theorem exists 
[Crisanti and Sompolinsky, 1987]. This last relation between the response and the 
correlation functions is, however, essential for extracting the long time properties of 
the dynamics. As a consequence, the long time limit has to be calculated via the 
full dynamic problem and cannot be evaluated by equilibrium statistical mechanical 
averages. 

Till now such models have been studied principally in the framework of neural 
networks model, and the interest has been mainly focused on the properties of the 
attractors of networks of spins with asymmetric couplings. In particular the effect of 
the degree of asymmetry on the long time behaviour has been analysed. Although 
analytical results, based on perturbation expansions in the nonlinearity parameter 
of soft spin models [Crisanti and Sompolinsky 1987], showed a drastic change in 
the deterministic dynamics as soon as the asymmetry was switched on, subsequent 
numerical data are in agreement with a transition at a finite degree of asymmetry 
[Spitzner and Kinzel 1989]. A perturbation expansion in the asymmetry parameter 
for the hard Ising spin seems to suggest a transition at a finite value of the asymmetry 
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parameter [Rieger et a/. 1989]. The location of the transition is, however, controversial. 

An interesting feature of these models is the presence of extremely long transients 
[Crisanti and Sompolinsky 1988, Niitzel 1991], i.e. the time the system wanders around 
before it settles down in the "asymptotic" regime. It has been found that while for 
nearly-symmetric networks the typical number of updates, before the relaxation onto 
the attractor, grows as a power of the system size, for strong enough asymmetry the 
transients are typically exponential in the size of the system [Niitzel 1991]. Therefore 
it is natural to study the properties of the transient, because they give the features of 
a large enough system during any reasonable time. 

In this paper we investigate the deterministic parallel dynamics of a fully connected 
Ising spin system with random quenched asymmetric interactions. We stress that if 
the spins are continuous, then this system exhibits chaotic behaviour, e.g. positive 
Lyapunov exponent, in the limit of high asymmetry [Sompolinsky et a/. 1988, Tirozzi 
and Tsodyks 1991]. In the case of Ising spins, however, because of the discrete nature 
of the states, it is not possible to characterize the time behaviour of the system by a 
straigthforword application of the most simple methods of chaotic dynamics, e.g. by 
the computation of the Lyapunov exponents. Nevertheless one can perform a study 
of the temporal evolution in terms of well defined quantities, such as Shannon and 
Renyi entropies, which give a non ambiguous degree of the "complexity" of the system. 
From these indicators and from the behaviour of the correlation function one has a 
strong evidence for a transition, at varying the asymmetry parameter, from regular 
to "complex" behaviour in systems of finite size. This transition is very similar to the 
onset of turbulence in the intermittent scenario in chaotic dynamical systems [Pomeau 
and Manneville 1980]. 

The model will be described in Sect. 2; Sect. 3 deals with the chaotic — i.e. 
complex, in the information theory meaning — behaviour during the transient and in 
Sect. 4 we study the fluctuations of the chaotic degree along the trajectories, in terms 
of the Renyi entropies. In Sect. 5 the reader will find a summary and conclusions. 

2. The model 

In this paper we consider an asymmetric spin glass model with deterministic dynamics 
[Crisanti and Sompolinsky 1987]. The model consists of N fully connected Ising spin 
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(T = ±1 interacting via quenched random asymmetric couplings of the form 



Jij = jfj + kJ^, k>0 (2.1) 

where Jj^ = jfj and Jj^ = —J^j, and denotes a pair of spins. The diagonal 

elements Jf^ are zero. The elements of the upper triangular part of the symmetric 

S A 

and antisymmetric matrices J and J are random independent Gaussian variables 
with zero mean and mean square equal to 1/{N — l)(l + /c^) so that the rows of the 
couplings matrices have average norm 1 independently of the system size or symmetry. 

The parameter k defines the symmetry of the coupling, and ranges from k = for 
symmetric through k = 1 for asymmetric to A; = oo for antisymmetric couplings. In 
the literature it is often used the related parameter A defined by 

A = = N [J,j Jj,] (2.2) 

ranging from A = 1 for symmetric through A = for asymmetric to A = —1 for 
antisymmetric matrices. In (2.2) square brakets denote average over the realization of 
the coupling matrix J. 

Our analysis is restricted to deterministic parallel dynamics, i.e. the spins are 
updated simultaneously according to 



ai{t + 1) = sign 



N 

^ Jij aj{t) 



(2.3) 



For any given sample J the dynamics is deterministic and depends only on S(0) the 
spin configuration {cTj} at time t = 0. 

For a system of N spins there are 2^ difi^erent possible states. The evolution (2.3) 
connects these states among them. Therefore for each realization of the couplings 
the structrure of the dynamics can be depicted in terms of oriented graphs, i.e. a 
set of points representing the states connected by arrows indicating the transitions. 
An example is shown in Fig. 1. Obviously each state has one and only one outgoing 
arrow, but different arrows can end at the same state. Since the number of states is 
finite and the dynamics is deterministic, each initial configuration of spins evolves to 
a definite attractor, which can be either a fixed point S(t + 1) = S{t), or a periodic 
repetition of I configurations S(t + Z) = S(t) (cycle of length I). 



From this remark one may be tempted to conclude that the behaviour of (2.3) is 
rather "trivial" in the sense that there is no possibility of having something similar 
to a chaotic behaviour. This is not completely true. In fact (2.3) can be seen as a 
cellular automaton, for which the behaviour just described is common. Nevertheless, 
it is well known that there is a wide class of cellular automata with rather "complex" 
behaviours. 

The reason is that the time it takes to reach the attractor can be very long. As 
a consequence the system may exhibit for a long time a rather complex behavior 
before it eventually relaxes to the "asymptotic" regime, usually a cycle. The presence 
of long transients, exponential in the system size, was first observed for sequential 
dynamics [Crisanti and Sompolinsky 1988] and recently analysed in more details for 
both sequential and parallel dynamics [Niitzel 1991]. 

From the above considerations it follows that in these models there are two relevant 
time scales: the relaxation time r and the cycle length /. These are defined as 

Z = minrS(t + n) = S(t)l (2.4) 

T = minrS(/ + n) = S(n)]. (2.5) 

The time r is the time the system needs to reach the first cycle of length I. In general 
both I and r depend on the initial state S(0) and on the coupling realization J^. 
For any given k and system size N one can define the average transient time and the 
average cycle length. To this end one considers a large number M of independent 
coupling realizations Jij. For each sample and a random initial state S(0) the time r 
and the cycle length / are recorded. One then defines the average values as 

1 ^ 

(0 = ]^ E ^(™) (2.6) 

m=l 
1 ^ 

= M E ^(™) (2-7) 

m=l 

where /(m) and T(m) are the values of I and r defined in (2.4) and (2.5) for the m-th 
sample. 

Studying these average quantities as a function of both the symmetry and the 
system size, Niitzel found strong numerical evidence for a transition between two 
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different behaviours as the symmetry of the couphngs is varied. He found that for 
high symmetric couphngs (l) is size independent and (r) grows as a power of N, while 
the behaviour of both quantities is exponential in N for high asymmetric couplings. 
He located the transition point around A ~ 0.5 where (/) shows strong changes [Niitzel 
1991]. By contrast (r) changes smoothly with A. This behaviour was found for both 
sequential and parallel dynamics. 

The values of / and r, however, exhibit strong sample to sample fluctuations. As 
a consequence the leading contributions to the average (2.6) and (2.7) come from rare 
events. This suggests that the appropriate quantity for averaging is not r and I, but 
their logarithms. One then defines the "typical" values 

Ttyp = exp(lnT) (2.8) 

V = exp(lnO. (2.9) 

An analysis of these quantities as a function of both the symmetry of the couplings 
and the system size reveals that 

Ttyp~ (r) ociV«('=)e^^'=)^ (2.10) 

where /3(A;) ^ 1 for /cc ~ 0.5. A similar behaviour is observed for the cycle length 1. 

We find that, ior k > kc, r has a roughly lognormal distribution whose peak and 
width scale linearly with N. In other words In r is a gaussian with 

{lnT)(xN (2.11a) 

((lnT)2> - (InT)V iV^. (2.116) 

The same result remains true also for sequential dynamics [Crisanti and Sompolinsky 
1988]. The lognormal distribution is quite common in disordered systems [Paladin 
and Vulpiani 1987]. However, in these models one has a non standard scaling of the 
variance of Inr. In fact usually both the mean value and the variance scale with N. 
This means that here there are enormous fluctuations: the ratio between the standard 
deviation and the mean value is constant instead of being proportional to N~^/'^ as 
in the standard case. 

The presence of these long transients, e.g. for k = 0.8 and N = 100 one has 
Ttyp = O(IO^), makes natural to study the dynamics during the transient. Not only 
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because this is the behaviour of the system on reasonable times, but also because this 
is the behaviour which is revealed by any mean-field study of these systems. 

To analyze the temporal evolution one of the first quantities one usually studies 
are the time correlations. For a given initial state S(0) and coupling realization J^- 
we compute the following quantity 



where the bar denotes time average. The correlation C{t) is evaluated taking into 
account only the data for the transient, i.e. times less than r. We remark that 
C (t) is not averaged over different realizations of . From the comparison of several 
realizations and different A^, it seems that C{t) is a sclfaveraging quantity that depends 
very weakly on A^. On the contrary Ci{t) = ai{t + 1') (Ji{V) changes at varying z; and 
there exist two different possibilities: Ci(t) either decreases monotonically with t, or it 
shows strong oscillations with a decreasing envelope. 

For k = 1 (full asymmetric case) one has C(t) = for t > 1. The behaviours of 
C{t) for A; < 1 are reported in Fig. 2a. Unfortunatelly one does not have a simple 
formula to fit C{t) as a function of t at different A;, even if, for each A;, the data seem 
consistent with a stretched exponential decay: 



Nevertheless one can define a characteristic time, Tc, as the time at which the envelope 
of C{t) reaches a threshold value, e.g. 1/e. Figure 2b shows 1/tc vs k\ one has evidence 
for a transition at 0.5. The above scenario does not change using different values 
for the threshold. 

3. Chaotic behaviour during the transient 

It is known [Isola et a/. 1985] that in some dynamical systems with many degrees 
of freedom the transition from regular to chaotic motion is also signaled by a change, 
from power to exponential in the number of degrees of freedom, of the Poincare return 
time. 




(2.12) 



i=l 



C{t) ~ exp[-at''] with h<l. 



(2.13) 
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This result and the analysis of the correlation functions discussed in the previous 
section suggest the possibility of a "chaotic behaviour" during the transients for enough 
asymmetric couplings. This is in spite of the fact that a stationary periodic orbit is 
always found to be the final attractor. The reason to study in more details this chaotic 
behaviour follows from the fact that if the asymmetry is strong enough the transient 
increases exponentially with the system size. Therefore any practical investigation of 
the time evolution is necessarily limited to the transient. Moreover one can argue 
that the attractor might not be relevant for the dynamics since even in the presence 
of stable solutions, generic initial conditions relax towards it only after exponentially 
long transients [Crutchfield and Kaneko 1988]. 

Due to the discrete nature of the spin and to the full connectivity of the system 
a quantification of "chaos" during the transient is not at all straightfowrard. In fact, 
for systems whose state changes continuously one can quantify the degree of chaos 
in terms of the Lyapunov exponents [Benettin et a/.1980a, b]. They measure the 
exponential growth rate of the distance between two initially close trajectories. 

One can try to follow the same idea of the Lyapunov exponents studing two 
trajectories whose initial condition S(0) and S'(0) differ by a single spin. Looking at 
the growth of the Hamming distance between S(t) and S'(t) one can then introduce 
something similar to the first Lyapunov exponent. This is the socalled 'damage 
spreading' method which revealed useful for discrete systems similar to (2.3) but with 
only local interactions among the spins [Kauffman 1969, Derrida and Stauffer 1986]. 

In this paper to characterize the chaotic behaviour we use a completely diff'erent 
approach. Following the basic idea of Shannon in the information theory [Khinchin 
1957], we look at the "complexity" of the temporal history on the z-th spin during 
the transient [Grassberger 1986]. For each initial configuration and fixed realization 
of Jij the "history life" of a spin cr^ before the system relaxes to the attractor can be 
written as a sequence 

(7i(0), a-j(l), . . . , a-j(m) (3.1) 

where m < r + 1. Since the transient increases exponentially with the system size, in 
principle the length of the sequence (3.1) can be done as large as we want by increasing 
N. 

The complexity of the temporal behaviour of the spin can be caracterized by 
looking at the average amount of information contained in the sequence (3.1). To this 
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end we consider a sequence ojn of n possible outcomes of the spin cr^. Since it can 
assume only two values there are 2" possible sequences. These can be regarded as 
strings of n binary digits. In general, the sequences cOn will appear in the history life 
of the spin cTj with different frequencies. Some of them may appear not at all or with 
very small probability. By computing the frequency with which each Un appears in 
the sequence (3.1) we can define the probability P{LOn) that the dynamics generates 
the sequence a;„. The measure of information contained in the knowledge of the P{ujn) 
is given by the entropy H{n) defined as 

H{n) = -Y. lnP(a;n) (3.2) 

where the sum is over all the sequences Un- If the sequence (3.1) is stationary the 
quantity H{n) depends only on n and not on the initial state (Tj(0). In this case, in the 
limit of large n the average information H{n)/n converges to the limit value h which 
is called the Shannon entropy of the sequence (3.1) [Khinchin 1957]. The existence of 
this limit implies that for large n the mean gain of information in considering sequences 
of length n+1 instead of n, i.e. 

h(n) = H{n+1)- H{n) (3.3) 

approaces a constant limit given by the Shannon entropy h. 

If the sequence (3.1) is a Markov chain, then h{n) = h for each n. This can be 
generalized to Markov chains of order p, i.e. the probability of having an event at 
time t depends only on the events at times t — p up to t — 1, in which case h{n) = h 
for n > p. 

The relevance of h follows from the first Shannon - McMillan theorem [Khinchin 
1957] which states that for large n the number of n-term sequences one can really 
observe in (3.1) is 

A^eff(n)-e'^". (3.4) 

This can also be stated as follows. For n sufficiently large all the n-term sequences 
cOn can be separated into two classes Oi(n) and Q,2{'n), such that for every sequence 
in the first class P{un) — exp(— /in) and 

P{u!n) 1 for n ^ oo. 
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On the contrary, for the sequences in the second class 



y ^ P{u)n) for n — > oo. 

If we remember that the maximum number of n-term sequences is 

iVmax(n) = 2" = e" 

we see that if /j, < ln2 for large n the class fii(n) contains only a negligible fraction 
of sequences. On the contrary, the overwhelming majority of such sequences fall into 
n2(n). 

If the probability of having 0"^ = 1 or cTj = —1 in (3.1) is the same, as it is in our 
case, then /i < In 2 signals the presence of a rule in the sequence. Thus the Shannon 
entropy gives a measure of the "complexity" of the sequence. In particular if /t = 
then we are in presence of periodic motion, while if /j, = In 2 the sequence is generated 
with an head and tail trial. We stress that In 2, the largest value attainable by /i, is 
reached only if the symbols in (3.1) are independent and equiprobable. In fact h <\n.2 
also if the symbols are independent but not equiprobable, e.g. generated according an 
head and tail trial done with an unbalanced coin [Khinchin 1957]. 

To analyze the motion of the system during the transient, we have computed 
the Shannon entropy of different spins for a fixed, randomly chosen, configuration of 
couplings Jij. In all the cases we have taken large enough to ensure sufficiently long 
transients: r ~ O(IO^) at least. For for k > 0.7 we considered = 100, N — 200 and 
TV = 300, while for /c < 0.7 we used N = 200 and TV = 300. For smaller value of k the 
required system size becomes very large and, since the computational time increases 
as N'^, it is practically impossible to reach too small values of k. In all the cases we 
checked that the sequence (3.1) for each spin is stationary. 

By computing h{n) for different n we found a rapid convergence towards the 
Shannon entropy h. In Fig. 3 it is shown a typical case from which we see that 
n = 4 or n = 5 are sufficient to have a good extimate of h. 

In the limit case of A; = 1 the evaluated h is very close to the largest value In 2. This 
is not surprising since if the couplings Jij and Jji are uncorrelated then the statistical 
properties of the dynamical system (2.3) are the same as the sequence generated by 
an head and tail trial [Gutfreund et aZ.1988]. 
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For a given configuration of couplings and a fixed value of N we have computed 
the Shannon entropy /i^*) for each sequence (3.1). The mean value 

<"> = ^ E 

seems to be a selfaveraging quantity, which does not depend on A^; moreover the 
variance 

i=l 

decreases for increasing N. In Fig. 4 we show (h) as a function of k: it is well evident 
the scaling 

(h) ~ (/c - kc)^ with /cc = 0.50 (3.5) 

We close this section with a remark. Note that the point at k = 0.56 does not 
agree very well with Eq. (3.5). Since it is practically impossible for us to work with 
smaller values of /c, we cannot say if this point can be considered as an evidence for a 
crossover behaviour. In Sect. 5 we shall consider again this issue. 



4. Fluctuations during the transient 

In general not all the 2"^ possible n-term sequences will appear in the sequence (3.1) 
generated by the dynamics. Nevertheless, for large n their number N[n) increases 
exponentially with n. The rate of growth 

Kq = lim - In iV(n) (4.1) 

n— »oo 77, 

is the topological entropy. The smaller Kq the larger the number of forbidden n-term 
sequences in (3.1). For our system we found that at any value of k the topological 
entropy assumes its maximum value Kq = ln2. This means that for fixed Jij and 
generic initial condition, all possible sequences are actually generated by (2.3). 

The topological entropy and the Shannon entropy are global quantities, since they 
ignore the finite time, i.e. finite n, fiuctuations. For any finite n we can define the 
"effective Sahnnon entropy" 7(n) of the n-term string ojn as 

7(n) = --lnP(a;n). (4.2) 
n 
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In general the value of 7(n) will depend on the string a;^, even for large but finite n. 
These finite n fluctuations can be characterized by means of the Renyi entropy [Renyi 
1970, Paladin and Vulpiani 1987]. Let us define 



Hq{n) 



1 



In 5^P(a;„)'^ 



(4.3) 



q-1 



'n 



where the sum is extended over all the 2"^ n-term sequences ujn- In the limit of large 
n the quantity 



or equivalently Hq{n)/n, converges towards the limit hq called Renyi entropy of order 
Q- 

From the definition it readly follows that Shannon and topological entropies are 
obtained from hq via h = limg^i hq and Kq = limg^o hq. It is possible to show that in 
general hq is a not- increasing function of q [Renyi 1970]. In the limit case of absence 
of fluctuations one has hq = Kq = constant. Thus the deviation of hq from Kq gives 
a measure of the relevance of the fluctuations. 

As we have done in Sect. 3 for the Shannon entropy, we have computed, for each 
sequence (Jj(l), (Tj(2), . . ., the Renyi entropies hq \ For values of k close to 1 hq^ does 
not change very much at varying q, while for k close to kc one observes large deviations 
of hq"^ from h^'^\ In Fig. 5 we show (hq) as a function of q for k = 0.9 and k = 0.7: 
even at a qualitative level, the difference is well evident. The properties discussed in 
Sect. 3, for the Shannon entropy, hold true also for hq-. each (hq) is a selfaveraging 
quantity which does not depend on N. 

The Renyi entropies are deeply related to the probability distribution -Pn(7) of the 
"effective Shannon entropy" 7(?i). For large n it is reasonable to make the ansatz that 
Pnil) vanishes exponentially [Eckmann and Procaccia 1986, Paladin et a/. 1986], 



The equal sign holds only for 7 = /i, as a consequence of the Shannon-McMillan 
theorem. With this assumption one flnds 



hq{n) = Hq{n + 1) - Hq{n) 



(4.4) 



P,(7)«exp[-n^(7)], ^(7) > 0. 



(4.5) 




1 

min 

q — 1 7 



[(g-l)7 + 5(7)]. 



(4.6) 
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ji = lim — 

n^oo n 



This is a Legendre transform which shows that each q selects a particular class of 
sequences with "effective Shannon entropy" 7. In particular q = 1 selects the most 
probable sequences, whereas for g 7^ 1 the leading contribution to hg comes from rare 
sequences. 

For --^ cri h one has the following parabolic approximation for ^'(7) 

= (4.7) 

where jj. is given by 

^ P{Un) [ In PK)] ' - [ J] In P{un)\ ■ 

= lim n / (7 - /i)^P„(7)d//. 

n— >cxD J 

Equation (4.7) corresponds to 

hg = h-fiiq-l)/2, g~l; (4.8) 

one can consider fi as an inhomogeneity factor. The (4.7) and (4.8) correspond to a 
gaussian approximation. The quantities h and n are the most relevant caracterizations 
for the "complexity" of the sequence since h gives the typical value and n is related 
to the variance of the fluctuations. 

We found that for k close to 1 /x assumes very small values, indicating that the 
sequences are almost homogeneous. When k is decreased fj, increases and assumes its 
largest values (strong fluctuations) as one reaches the critical value kc In Fig. 6 we 
show {fj) as a function of k. 

It is interesting to note that the behavior of (h) and (/u) as function of the parameter 
k is similar to the one observed for the intermittent transition in dymical system, e.g. 
in the Lorenz model [Pomeau and Manneville 1980]. 

We close this section noting that all the results for (h) and {fx) for k larger than 
approximately 0.5 are practically independent of N in the range N = 50-^ 500. 
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5. Summary and conclusions 

In this paper we have studied the long-time behaviour of binary sequences, obtained 
from the deterministic evolution of an asymmetric neural networks model with N 
components. The system size N is large but finite. In spite of the discrete nature 
of its states, at varying the asymmetry parameter fc, one observes some features very 
similar to the intermittent transition in chaotic systems. For k < one has that 
the typical lenght of the transient follows a power law in the size of the system N , 
while for k > the transients increase exponentially with N. One can define, in an 
unambiguous way, some degree of "complexity" during the transient, by using well 
established concept (Shannon and Renyi entropies) in the information theory. 

For k > kc the time behaviour of the transient is very similar to that one in 
the chaotic systems: decay of the temporal correlation and positive Shannon entropy. 
Around kc one has a scaling law for the mean Shannon entropy (h) : 

(h) ~ y^k-kc, 

moreover the fiuctuations of the degree of chaos, given by the mean inhomogeneity 
factor ((u), are large for k approaching /c+. 

All our results on the Shannon and Renyi entropies and characteristic times for 
k larger than approximately 0.5 do not depend on the value of in the investigated 
range N — 50-i-500. However, in principle, we cannot exclude the possibility that what 
we found is not a real sharp transition, but the manifestation, at finite A, of a crossover 
behaviour. For instance, for the sequential dynamics [Crisanti and Sompolinsky 1988] 
one has an exponential growth with N for Ttyp according to (2.10) even for k < k^ 
but the constant P{k) is so small that in order to see the exponential law one has 
to consider enormous systems, A = O(IO^). In a symilar way in the above quoted 
reference the average correlation function during the transient has a characteristic 
time Tc proportional to k~^ for small k. 

From our computations and the previous study of Niitzel [1991] one can conclude 
that the dependence of kc on A, if any, is very weak. For almost all the practical 
purposes, however, the nature of the transition, i.e. sharp or crossover, is not very 
important. Nevertheless, its existence is relevant for numerical studies. For example, 
it could be very dangerous to compute temporal averages at different k using the same 
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N and maximal time. Indeed the meaning of these averages is completely different: 
for k > kc one should have informations about the transient while for k < k^ one just 
observes properties of the periodic attractors. 

We conclude by noting that similar problems are present also in hamiltonian (and 
more generally symplectic) systems with many degrees of freedom [Falcioni et a/.1991]. 
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Figure captions 



Figure 1. Some examples of possible behaviour. One recognizes two fixed points and 
three cycles of period 2, 3 and 4, respectively. 

Figure 2. a) C{t) as a function of t for A; = 0.6 (diamonds) and k = 0.8 (plus); in 
order to evidenciate the main feature we plot C{t) only at even values of t. b) 1/tc as 
a function of k. The system size is N = 200. 

Figure 3. h{ri) as a function of n for one spin sequence at A; = 0.7 and N = 200. 

Figure 4. (h)'^ as a function of k ioi N = 200; the dashed line indicates the law 
(h) (X {k — kcY^'^ with kc = 0.50. The horizontal line corresponds to (h) = In 2. 

Figure 5. (hq) as a function of q ior k = 0.9 (plus) and k = 0.7 (cross). The system 
size is iV = 200. 

Figure 6. {/j) as a function of k for N = 200. 
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